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ABSTRACT 

An  important  example  of  an  event  which  obeys  the  geometric 
probability  law  with  parameter  0  is  the  number  of  cycles  required 
to  obtain  the  first  failure  of  an  item,  where  the  success  of  each 
cycle  is  independent  with  probability  of  success  0. 

The  true  probability  of  success,  in  manufactured  items,  is 
usually  unknown  and  must  be  estimated  on  the  basis  of  observed 
data  obtained  from  a  test  of  sample  items.   An  important  estimator 
for  this  probability  is  the  unbiased  estimator,  defined  as  that 
estimator  whose  expected  value  equals  the  true  value  of  the  para- 
meter.  In  this  study,  an  unbiased  estimator  for  0  is  derived. 
This  estimator  is  based  on  the  results  of  a  series  of  independent 
items,  each  cycled  to  first  failure. 

Series  approximations  for  the  variance  of  this  estimator  are 
derived,  and  some  values  of  the  variance  are  tabled  for  those 
cases  thought  to  be  of  special  interest. 
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TABLE  OF  SYMBOLS  AND  ABBREVIATIONS 

Symbol  Description 

0  Probability  of  success  of  a  single  cycle 

n  Number  of  items  cycled  till  first  failure 

s  Total  successful  cycles  completed  in  n  tests 

Ng  The  number  of  ways  n  tests  can  sum  to  s  successes 

0  The  unbiased  estimator  for  0 
s 

Ms  The  product   (  Ns  0S  ) 

R  The  ratio  ^~- 


IV 


1.    Introduction. 

The  geometric  probability  law  with  parameter  9,  where 

0^9—1,  is  specified  by  the  probability  mass  function; 

p(x)  =  9X  (1  -  9)    for  x  =  0,  1,  2,  .... 

=  0   Otherwise, 

where  x  is  the  number  of  successful  cycles  to  first  failure  of 

one  item. 

When  n  independent  items  are  cycled  to  first  failure,  the 

probability  of  each  ordered  event  is 

m  _ 

T~f9Xz(l-9)  =  9S(l-9)n   where  s  =  2.x;  . 

The  probability  of  exactly  s  successes  is  thus  the  union  of 
all  events  with  exactly  s  successes.   The  number  of  such  events  is 
the  number  of  ways  n  tests  can  sum  to  s  successes.  Therefore} 
p(s)  =  Ns9S(l-9)n   for  s  =  0,  1,  2,  3,  ...... 

=  0  otherwise. 
Since  N,  M,  and  9  are  functions  of  both  n  and  s,  the  subscript 
(n,s)  is  necessary  to  uniquely  identify  the  value.   However,  since 
n  is  a  known  variable  which  is  fixed  prior  to  testing  <,  the  abbre- 
viated subscript  s  will  be  used. 

*  *  *  *  *  *  *  *  * 


2.   Derivation  of  the  Unbiased  Estimator. 

/» 
By  definition,  and  estimator  0  is  unbiased  if  its  expected 

value  equals  the  true  value  of  0,  where  the  expected  value  E(0  ) 

is  defined  by 

E(®s)  =  2-  ®s  P(s)   over  all  s  such  that  p(s)>0. 

s 

Thus,  0  is  an  unbiased  estimator  for  0  if  and  only  if 


go 

0  =  Z.  0S  Ns  0s  (l-0)n 

StO 

CO 

=  X  Ms  qS  (1"0)n  ' 


SmO 

By  expanding  the  (l-0)n  term,  the  summation  becomes 

e  -  Ims  8s  [i  -  (;)o  +  (5)92 +(-i)n"1(n!>n"1  +  (-Dn  enl 

-  H,  [  i  -  (?)e   +  (5)e2 +<-1)n"1(n:>n"1  +  (■*>"  «n    ] 

+  Ml  [e  -  (?)e2  +  (5)e3 +<-i>n"1(n?1)<>n     +  C-D"  9n+1] 

+  m2  [e2  -(?)e3  +  (5)e4 +(-Dn"1(n^1)en+1  +  (-i)n  en+2] 

+  ------  etc. 

Rearranging  terms  as  coefficients  of  a  power  series  in  9,  we  obtain 

e  -    [Mo] 

+  e  K-(?H] 
+  «2[m2-(iK  +  (sK] 

+  e3[M3-(?)M2+(5)M1-(§)Mo] 

+   -  -  -   etc.,  until  the  0nth  term.  Then, 


[ 

[Mn+2 


+  9n+1  I  M 


(;K 


+  - 


+  - 


(ih+i + 


"  +   (-1)""1   (n-l)M2  +   C-1)"  Ml] 
-+(-Dn-1(n-l)"3+(-1)nM2] 


etc . 


By  equating  coefficients:  MQ      =     0 

[mi  -  (iK]  =  x« 

All  remaining  coefficients  are  zero. 

Solving  for  Ms   (s  =  0,  1,  2, ),  the  following  table  of  equations 

is  produced: 
Mq  =  0 


M,    =     1 


Mo    = 


M0    =      V  M 


M/,    = 


Mr    = 


M.    = 


(l)Ml 
(l)M3 

(!K 

(l)M5 


=  (iY 


M-7    =      V  M, 


(§)mi 

($)m3  +  (§)m2 
(?K  +  (?)m3 

(5)m5  +  (5)m4 


Example  of   table 
with     n  =  5. 


(1) 


-(*) 


Mi 


M8  -   (?)M7    "    (SJ««  +  (I)* 


(*)«3  +  (?)M2 
(4H  +  (SK 


-  (g)% 

-  (>2  +  (?)Mi 


and   so    forth. 
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Initial  numerical  solutions  for  M  are  as  follows 

s 

M0  =  0 
M  =  1 
M2   =     n 


M3   = 


M4 


"  (?)»  -  (J)  -   Hfejil  -  (nr) 

-  [iti1)  -  (5)n  +  (?)  -  n(n+1)^n+2)    -  (n+2) 


Thus,  M  can  be  written  as  the  expression 


M 
lls 


=  (n+!j2)   for  5=0,1,  2,  3,  4, 

The  proof  that  this  expression  holds  for  all  s  will  be  by  induction. 

The  assumption:  M.,  =  (nt-i2)   for   i  =  0,  1,  2,  3,  ---,  (k-1) 

To  prove:   Mk  =  (nJ^J2)  • 

From  equations  (1),  M^  can  be  written  as  the  following  summation  of 
the  M±: 

But  [*M  =  I*1   J  -  [,n,l  '    Performing  this  trans  formation ,  we  have 

T^    i  /n\f/n+k-i-l\    /n+k-i-2|)     m+k-21 
JC-D   (i)((    n   J  "  (    n   ))  "  I  k-1  I      . 


Mk  =  - 

L  i-o 

Let  X  =  n+k-1,  and  Y  =  n+k-2.  Then, 
M 


■  i^m^-z^imv)*  (n£i2) 


k 
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By  use  of  the  following  combinatorial  identity: 

j>  (-D'UHV)  -  1>   for  Z>n, 
which  is  derived  in  Appendix  I,  the  desired  solution  is  obtained, 

1^-1-1  iTl2)  -  [T-l2] . 

The  number  of  ways  n  tests  can  sum  to  s  successes, 
and  the  value  for  Mg  i 


M 
s 


-  m2) ,  <3> 

which  was  just  proved,  provides  the  derivation  for  9  . 


Mc  c„±„.oM 


0     =     —  (n+s-2)!    (n-1)!    s 


7s 


Ns  (n-1)!    (s-1)!    (n+s-1)! 

I  n^T  ^   s>0-  <*> 


? 


for  s  =  0. 
Thus,   0S    is   equal   to   the  number   of   successful   cycles,    divided  by  the 

total  number  of  cycles  minus   one. 

it  it  it  it  it  it  it   it  it 


3.   Derivation  of  the  Variance. 

The  variance  of  a  random  variable  is  defined  by 
Var(X)  =  E(X2)  -  E2(X). 
Therefore,  the  variance  for  the  unbiased  estimator  0  can  be 
obtained  by  solving  the  following  equation: 

Var(9s)  =  E(&s)  "  E2(0S). 
Equation  (4)  gives  the  value  for  0  such  that  E(0  )  =  0,   Therefore, 

S  D 

2  A        9  * 

E  (0S)  =  0  .   However,  since  the  derivation  of  E(0g)  provides  a 
formula  which  is  useful  in  deriving  the  second  moment  E(0  ),   the 
reverse  computation  will  be  shown, 

E(0s)   =        29sNs   qS    O0)n     =      <1_e>n     5  Ms   9s 

S*0  S-.O 

-  ^)ni(Ti2)  *s  • 

5*0 

Since  the  s=0  term  equals  zero,  the  summation  index  can  be  changed, 

Sew    -   °f(nrs)°s- 

s-o  s-o 

By  use  of   the    following   identity  (also   derived   in  Appendix   I),    namely 

2  (    i  )  9     "      d-e>N    • 

o.    -      -.    .  1 


.  i  ,.•  «c-  /n-l+s|Qs      _ — 

the   summation       ^>  /  y0        -      ,,      *n      , 


s-o 

and 


9 


2(ns-i2K  -  <i-«n  •  <6> 


s-o 


Thus  S  /-l     Mn    a 

E<§s)   -     ^T1       ■     9    ,      and     E2(§s)      -     e2.  (7) 

(.1-0; 


Similarly,  to  find  the  second  moment,  we  note  that 
*2      <r-  *  2     s      n 

E(ep  =  2.  (0s>  Ns  e  <x-9> 

■  <l-e>n  ffjsM2  ("ft1)  *s  •        <« 

2 

But  (   s   1   =  (       s   U— S l)+(_5__\ 

\ n+s-l/    ln+s-l/^n+s-1    /   ^ n+s-l/ 

^n+s-lHn+s-1/   ^ n+s-l/ 

(  n+s-lj (n+s-lj   (  n+s-l] 

Substituting  this  expression  into  equation  (8),  and  using  equation 
(6),  we  obtain 

E(^  .  (l.e)«  f  {^y    _     (1.e)n  I (-Si)^)  es 

oo 


-  •-  ^)nI(^r)(n:!i2)^ 


SiO 

n-1 

9 

Multiplying  by  a  factor  n-l  >  w&  have 


.«)-  -^If^ijfc2)^-1 


s*o 


=  0  _  ©(n-l)  R"n  5  -W1^;2  e^5"1 


n+s-l  V  n-l 


=  e  -  e(n-i)  R"n  f(e)  ,  (9) 


5*0 


w-  t^iTS)^-1 


Differentiating  equation  (10)  ,  we  have 


f'o)  =  go)  =  f  ^4  (n+s:2)er 

£—   n+s-l  \    n-1  / 


9n-2  J  ,n+s-2  ,  eS 

s-.o  y    n_1 


Thus,  by  substituting  equation  (6j) ,  we  obtain 


g(e)  « 


(i-e)n  • 

This  expression  must  be  integrated  to  obtain  f(9).  Thus, 
f(e)  =  Jg(0)  +  C  =  G(0)  +  C  , 


where : 

G(e)  =  \rr—n  de 


"J  d-e)n 


1 

Integrating  by  parts,  letting  u  =  0     and  dv  =  (l-0)"nd0, 


G(e)=  A_(^_\n'1-^-(^-r2+  -±-(-°-r3--- 

KJ  n-lU-0/      n-2  U-e/      n-3|l-0/ 

+  (-i)n+1  ^_§_)2  +  (-Dn[^)  +  (-Dn  ln(l-e).  (11) 


To  find  the  constant  C,  equations  (9)  and  (11)  are  evaluated  at 
0=0.   The  constant  equals  the  difference  f(0)  -  G(0)  for  all  0, 

f(0)  =0,   and 
G(0)  =  +  ln(l)  =  0. 


Thus  the  constant  C  is  zero.   Therefore. 


f  (0)   =  4r  Rn_1    -   -±r  Rn'2  +  ~~  Rn"3 
v    '        n-1  n-2  n-3 


-   +    (-I)"  £  R3 


+    (-l)n_1   j  R2   +   (-!)"  R     +    (-l)n    ln(l- 


9).  (12) 


a2 

Substituting  equation    (12)    into    (9)    gives    the   solution   for  E (0  ) 


,*2 

E(ec 


)   =  0   -   8(n-l)f  -ir  R   -  — 

L  n-l  n- 


2  13 

7  R     + -i  R 
2  n-3 


+   (-I)""1  I  Rn"2  +   (-i)n  Rn"l  +   (-i)n  Rn   In(l-e) 


(13) 


Substituting  equations  (13)  and  (7)  into  equation  (5)  provides  the 
derivation  of  the  variance. 


{< 


Var(0s)  =  04(1-9)  -  (n-l 


1       1   2    1  «3 

n-l     n-z      n-j 


+  (-i)11"1  1  Rn-2  +  (-l)nRn"1  +  (-l)nRnln(l-e; 


(14) 


i<    -k    i(    "k    'k    i(    "k    "k    ?V 


4.   Numerical  Analysis  of  Variance. 

The  equation  (14)  for  Var(0s)  lends  itself  nicely  to  re- 
cursive numerical  analysis.  If  the  alternating  series  in  the 
square  brackets  is  considered,  for  various  values  of  n,  we  have 

n=2    R  +  R2ln(l-0)    =   R(l  +  Rln(l-G))  , 

n=3    \   R  -  R2  -  R3ln(l-9)    =   R(  ~   -  R(l  +  R  ln(l-G)))  , 

n=4    h-k  +  R3  +  R4ln(l-0)   = 

(15) 

R(  J  "  R(  2  "  R^  +  R  ln(1"e>)))j 

and  so  forth.   If  RWn  is  set  equal  the  sum  of  the  series  in  equa- 
tions (15),   Q  is  defined  as  -R,   and  L  =  (1  +  R  ln(l-0)),  then 

W2  =  L  , 

W3  =  LQ  +  I  , 

W,  =  (LQ  +  \   )Q  +  \    , 


W5  =  ((LQ  +  \   )Q  +  |  )Q  +  \    ;      etc 


Var(0fe)  can  be  re-written  as 

Var(9s)  =  e[(l-9)  -  (n-1)  R  Wn]  , 

where  Wn  is  defined  by  the  following  recursive  formula, 
W2  =  (1  +  R  ln(l-G)),   and 

W  =  W  ,  (-R)  +  -~  . 
n    n-1  v   /    n-1 

10 


A 

Appendix  II  provides  tables  of  Var (9  )  for  15  values  of  9 
and  representative  values  of  n  between  one  and  50.  input  data 
with  nine-place  accuracy  was  used  in  compiling  these  values. 

Any  output  error  (E  )  in  this  data  is  a  result  of  the  natural 
limitations  on  input  data  degrees  of  significance,  and  occurs  in 
the  bracket  summation.  We  have 

Eq  =   +(-l)n"1(.6666---+ga)  Rn~6  +  (~l)n(e2)  Rn"5 

+  (-l)n_1(.25)  Rn"4  +  (-l)n(.333— +€,)  R*1"3  +  (-l)n  Rn'1 

+   (-l)n  Rn  (ln(l-G)  +  €e)   . 
Thus,  for  input  data  significance  of  degree  ^  3, 


#  --  etc. 


For  values  of  9  >  .5   (i.e.,  for  values  of  R  £   1.0),   the  com- 
puted variance  has  approximately  the  same  degree  of  accuracy  as  the 
input  data.   For  smaller  values  of  9,  however,   E   rapidly  exceeds 
the  value  of  the  variance  as  n  increases. 

As  an  example,  with  an  input  accuracy  to  nine  decimal  places^ 
9  =  0,05,   R  =  19,  and  n  =  6  , 

Eo~(0.€ox  10_9)(196)  =  (0.€ox  10"9)(4.7xl07)£  (4.7xlQ~3) 

but  the  variance  at  n  =  6  is  less  than  9  x  10   .  The  tables  of 

Appendix  II  indicate  this  decrease  in  accuracy  for  values  of  ©  <  0.5 

Since  9  is  normally  larger  than  0.5  for  items  that  are  cycled 

to  failure,  the  inherent  error  term  for  small  0  is  expected  to  place 

little  restriction  upon  the  use  of  the  tables. 

11 


APPENDIX  I 
PROOF  OF  COMBINATORIAL  IDENTITIES 
A.   To  prove: 

71 


Each  I    1  term  can  be  written  as  a  linear  combination  of  J  .1 

terms,  where  j  =  0,  1,  2,  ---,  n,  by  successive  application  of  the 
rule: 

(?)  -  m +  ra  • 

Thus: 

(x)  -  (s)(xsn) +  (?)(xr)  +  (t)(x?V  -  -  -  -  +(2)(xr) 
(x;1)-        (V)(x:V(V)(x;t---+(-M 

(x;2)  =  (V)(xr)+  -  -  - +  (s:2)(xr) 

(etc.,  until  finally:) 

i<->1(-)(n;i)  - 

(5)(8)(V)  -  (S)(!)(xin)  ♦  (S)(f)(Y)+ ♦  (3)(;:)(x;1 

-(!)M(xr)-(!)(V)(xr)-----(?)(s:i)(xr) 

(s)(V)(x2n)---  +  (^:2)(x;n); 


+  9 


etc. , 
12 


(to  the  last  ter»>  (-1)"  (  ^f?) 

By  summing  on  like  coefficients,  we  have 


1  + 


*=/ 


1  + 


|(xrj  i^UK-) 


It  will  now  be  shown  that  the  summation  in  the  square  brackets 
equals  zero . 


im 


n!    (n-i)! 


r! 


i!  (n-i)!  (r-i)!  (n-r)!   r! 


im 


Thus,  the  summation  in  the  square  brackets  can  be  written  as 


But  this  equals  zero,  as  can  be  seen  from 


(*+y)r=  (JK  +  (f) 


y*-1  y  + 


aK 


Letting  x  =  1  and  y  =  -1,  the  solution  is  provided. 


(SH1N2) +  <-«*(?)  -    ii-rfli)-  0 


*  *  *  * 


B .        To   prove  : 


CO     1 

i-o 


■JV 


I  («U 


(l-e) 


N+l 


t=0 


13 


This  proof  can  be  seen  from  the  successive  differentiation  of 


1 
1-0 

1 

(1-0)2 

=      f  a  +  i)  e1  , 

1 

(1-0)3 

-       i(2^ei; 

t--0 

etc.  By  induction, 


*  ■  2  (T) ei 


(1-0) 

1  =  0 


******  *  *  * 
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APPENDIX  II 
TABLES  OF  VARIANCE 


n 

9  =  .99< 
0009990( 

)    e  =  .99 

e  =  .95 

0  =  .90 

0  =  .80 

1 

)    .00990000 

.04750000 

.09000000 

.16000000 

2 

00000591    .00036517 

.00538351 

.01558428 

.04047190 

3 

00000099    .00009262 

.00193332 

.00653683 

.01976405 

4 

' less  \ 

.00004860 

.00109737 

.00391053 

.01258848 

5 

.00003268 

.00075632 

.00275400 

.00913717 

than 

6 

^  ID"6  i 

.00002459 

.00057524 

.00211750 

.00714463 

7 

.00001970 

.00046367 

.00171767 

.00585661 

8 

.00001643 

.00038820 

.00144401 

.00495849 

9 

.00001410 

.00033379 

.00124521 

.00429757 

10 

.00001234 

.00029274 

.00109435 

.00379131 

12 

.00000988 

.00023491 

.00088071 

.00306739 

14 

.00000824 

.00019614 

.00073676 

.00257505 

16 

.00000706 

.00016835 

.00063321 

.00221867 

18 

.00000618 

.00014746 

.00055516 

.00194882 

20 

.00000549 

.00013118 

.00049423 

.00173744 

25 

.00000430 

.00010279 

.00038780 

.00136670 

30 

.00000353 

.00008451 

.00031907 

.00112630 

35 

.00000300 

.00007175 

.00027107 

.00095780 

40 

.00000260 

.00006233 

.00023557 

.00083315 

45 

.00000230 

.00005510 

.00020831 

.00073720 

50 

.00000206 

.00004937 

.00018671 

.00066107 

15 


n 
1 
2 
3 
4 
5 
6 
7 
8 
9 
10 

12 
14 
16 
18 
20 

25 
30 
35 
40 
45 
50 


6  =  .70 
.21000000 
.06479650 
.03446014 
.02284705 
.01694454 
.01342257 
.01109697 
.00945152 
.00822783 
.00728301 

.00592068 
.00498649 
.00430640 
.00378929 
.00338292 

.00266745 
.00220165 
.00187430 
.00163166 
.00144463 
.00129606 


9  =  .60 
.24000000 
.08434420 
.04754107 
.03245893 
.02448095 
.01959921 
.01632064 
.01397284 
.01221117 
.01084162 

.00885224 
.00747794 
.00647221 
.00570452 
.00509941 

.00403018 
.00333140 
.00283904 
.00247343 
.00219123 
.00196682 


8  =  .50 
.25000000 
.09657359 
.05685282 
.03972077 
.03037231 
.02453463 
.02055846 
.01768180 
.01550652 
.01380517 

.01131743 
.00958726 
.00831498 
.00734031 
.00656988 

.00520383 
.00430779 
.00367488 
.00320407 
.00284018 
.00255049 


8  =  ,40 
.24000000 

.09974306 

.06077082 

.0432656 

.0334686 

.0272462 

.0229567 

.019825 

.017441 

.015567 

.012809 

.01087 

.00945 

.00835 

.0074 

.0059 
.004 


8  ■  .30 
.21000000 

.09256908 

.05801098 

.0419615 

.0327862 

.0268734 

.022754 

.019723 

.017402 

.01556 

.0128 
.0109 
.009 
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n 


0  =    .20 


e  =  .10 


e  =  .05 


-   .03 


=    .01 


1 

.16000000 

.09000000 

.04750000 

.02910000 

.00990000 

2 

.07405936 

.0434201 

.0233439 

.0144022 

.00493 

3 

.0475250 

.028436 

.015429 

.00955 

u003 

4 

.034849 

.02110 

.01151 

.007 

5 

.02746 

.0167 

.0091 

6 

.02265 

.013 

.007 

7 

.0192 

.01 

8 

.0167 

9 

.014 

10 

.013 

12 

.01 

14 

16 

18 

20 

*  *  it  it   it   it   it  it   it   it   it 
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